Local measures of information storage in complex distributed computation

نویسندگان

  • Joseph T. Lizier
  • Mikhail Prokopenko
  • Albert Y. Zomaya
چکیده

Information storage is a key component of intrinsic distributed computation. Despite the existence of appropriate measures for it (e.g. excess entropy), its role in interacting with information transfer and modification to give rise to distributed computation is not yet well-established. We explore how to quantify information storage on a local scale in space and time, so as to understand its role in the dynamics of distributed computation. To assist these explorations, we introduce the active information storage, which quantifies the information storage component that is directly in use in the computation of the next state of a process. We present the first profiles of local excess entropy and local active information storage in cellular automata, providing evidence that blinkers and background domains are dominant information storage processes in these systems. This application also demonstrates the manner in which these two measures of information storage are distinct but complementary. It also reveals other information storage phenomena, including the misinformative nature of local storage when information transfer dominates the computation, and demonstrates that the local entropy rate is a useful spatiotemporal filter for information transfer structure.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

The local information dynamics of distributed computation in complex systems

Joseph Troy Lizier Doctor of Philosophy The University of Sydney October 2010 The local information dynamics of distributed computation in complex systems The nature of distributed computation in complex systems has often been described in terms of the component operations of universal computation: information storage, transfer and modification. This thesis makes the original contribution of a ...

متن کامل

A framework for the local information dynamics of distributed computation in complex systems

The nature of distributed computation has often been described in terms of the component operations of universal computation: information storage, transfer and modification. We introduce the first complete framework that quantifies each of these individual information dynamics on a local scale within a system, and describes the manner in which they interact to create non-trivial computation whe...

متن کامل

Measuring information storage and transfer in swarms

Spatial aggregation of animal groups give individuals many benefits that they would not be able to obtain otherwise. One of the key questions in the study of these animal groups, or “swarms”, concerns the way in which information is propagated through the group. In this paper, we examine this propagation using an information-theoretic framework of distributed computation. Swarm dynamics is inte...

متن کامل

Entropy-based Consensus for Distributed Data Clustering

The increasingly larger scale of available data and the more restrictive concerns on their privacy are some of the challenging aspects of data mining today. In this paper, Entropy-based Consensus on Cluster Centers (EC3) is introduced for clustering in distributed systems with a consideration for confidentiality of data; i.e. it is the negotiations among local cluster centers that are used in t...

متن کامل

Detecting Non-trivial Computation in Complex Dynamics

We quantify the local information dynamics at each spatiotemporal point in a complex system in terms of each element of computation: information storage, transfer and modification. Our formulation demonstrates that information modification (or non-trivial information processing) events can be locally identified where “the whole is greater than the sum of the parts”. We apply these measures to c...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • Inf. Sci.

دوره 208  شماره 

صفحات  -

تاریخ انتشار 2012